AD-A213  095 


htehoTB**  flpfftrw* 
tj«*f  national®* 


THE  RELVTIONSHIP  BETWEEN 
SUBJECTIVE  AND  OBJECTIVE  MEASURES 
OF  SIMULATOR-INDUCED  ATAXIA 


U  4  10 

^  ELECTE 
SEP  2  9 1989 


[>  v.  i  i:  in.  c;  i;  a  in  d  civil  ins  t  l  t  ij  t  e 

O  l;  L  IN  V  L  R  ONME  IN  T  /V  L,  M  L  t)  l  C!  l  IN  L 


June  1989 


UNCLASSIFIED 


3 


DCIEM  No.  89-RR-28 


THE  RELATIONSHIP  BETWEEN 
SUBJECTIVE  AND  OBJECTIVE  MEASURES 
OF  SIMULATOR-INDUCED  ATAXIA 


L.  Kantor 
L.E.  Magee 
K.M.  Hamilton 


Defence  and  Civil  Institute  of  Environmental  Medicine 

1133  Sheppard  Avenue  West 

P.O.  Box  2000 

Downsview,  Ontario 

M3M  3B9 


OTIC 

electe 

SEP  2  9 1989 


i . . . 


DEPARTMENT  OF  NATIONAL  DEFENCE  -  CANADA 


;■  i,  tau*  bai*  approrSf" 

iv*.  ,  vk  'ir  dImm  end  Ml*  Mi 


■.i.iitiLr.vl'jai  to  aalhattaMi 

g9  9  29  04  5 


Table  of  Contents 


ABSTRACT 
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''^Subjective  reports  of  simulator-induced  ataxia  are  difficult  to  corroborate  using 
objective  tests  of  balance,  Two  reasons  for  this  are  ceiling  and  practice  effects  that 
occur  with  objective  tests  of  balance.  In  the  present  experiment  an  attempt  was  made 
to  overcome  these  problems.  Postural  control  was  assessed  subjectively  following  expo¬ 
sure  to  a  general  purpose  flight  simulator  and  objectively  using  four  balance  tests 
specifically  designed  to  avoid  ceiling  effects.  The  experimental  design  was  intended  to 
control  for  practice.  Despite  these  procedures, 'Subjective  reports  of  disequilibrium  fol¬ 
lowing  training  were  verified  by  only  one  of  the  balance  tests;  the  Walk  On  Rail  Eyes 
Open  (WOREO)  was  reliable  in  showing  loss  of  postural  control.  The  results  suggest 
that  the  WOREO  should  be  used  as  an  objective  test  for  studying  postural  disequili¬ 
brium  following  simulator  exposure,  ,  >v  ,  y  (  5 ! 
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INTRODUCTION 


v  Flight  simulator  arc  often  used  to  help  train  the  aircrew  of  modern  aircraft  but 
simulator  Training  sometimes  leads  to  unwanted  aftereffects  commonly  called  simulator- 
induced  sickness  (l,2!).  Subjective  reports  of  simulator-induced  sickness  include  loss  of 
balance  (ataxia),  dizziness,  nausea,  headache,  eyestrain,  and  general  discomfort v{3)). 
Symptoms  of  balance  loss  are  particularly  worrisome  because  of  their  potential  to 
compromise  safety  following  simulator  training'(4).  While  the  reason  flight  simulators 
produce  ataxia  in  some  aircrew  is  not  clear  most  investigators  speculate  that  it  is  caused 
by  readaptation  of  the  human  spatial  orientation  system  to  the  real  world  following 
adaptation  to  the  artificial  environment  provided  by  the  simulator  (§,8^ 

Paradoxically,  subjective  reports  of  ataxia  following  simulator  training  arc  not 
always  confirmed  by  objective  tests  of  balance  (1,7).  Two  possible  reasons  for  this  are 
coiling  effects,  and  practice  effects  associated  with  repeated  test  presentation  procedures 
used  in  simulator  sickness  research  (8,9).  Ceiling  effects  may  be  overcome  by  using  more 
difficult  tests.  Practice  effects  may  be  minimized  by  pretraining  subjects  or  controlled  by 
using  two  groups  of  subjects;  an  experimental  group  and  a  control  group.  Pretraining 
can  be  impractical  for  two  reasons.  First,  it  is  time-consuming.  A  recent  study  found 
that  18  to  24  repetitions  were  required  for  performance  to  stabilize  on  a  number  of 
objective  clinical  ataxia  tests  (8).  Second,  with  pretraining,  the  behaviours  involved  in 
performing  the  tests  could  be  over-learned,  which  may  cause  performance  to  become 
resistant  to  disruptive  stimulation  (10).  While  controlling  for  the  effects  of  practice  is 
less  time-consuming  and  reduces  the  possibility  of  over-learning,  a  major  drawback  of 
this  approach  is  that  twice  as  many  subjects  are  required, 

The  purpose  of  this  study  was  to  investigate  the  relationship  between  subjective 
and  objective  measures  of  ataxia  by  employing  performance  tests  designed  to  avoid  ceil¬ 
ing  effects  and  an  experimental  design  intended  to  control  for  practice. 
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METHOD 

Subjects 

Twenty-nine  military  college  students  awaiting  pilot  training  and  nine  civilians 
undergoing  screening  at  the  Canadian  Forces  Aircrew  Selection  Centre  volunteered  for 
this  study.  Since  alcohol  afTects  equilibrium  (11),  five  participants  were  excluded  because 
they  reported  drinking  alcohol  less  than  12  hours  before  testing.  The  remaining  subjects 
(n=33)  had  a  mean  age  of  21.0  years  (range  19-27).  None  reported  any  balance  prob¬ 
lems  before  the  study  began,  Subjects  were  randomly  assigned  to  a  control  (16  males)  or 
experimental  group  (10  males  and  1  female). 

Apparatus 

The  flight  simulator  used  in  this  study  was  the  Canadian  Automated  Pilot  Selec¬ 
tion  System  (CAPSS).  This  simulator  was  designed  to  gradually  teach  aircrew  candi¬ 
dates  the  skills  required  to  “fly”  a  circuit  by  instruments,  This  system  is  a  Singer-Link 
general  aviation  trainer  instrumented  to  teach  basic  instrument  flight  and  to  record  stu¬ 
dent  progress  automatically.  The  cockpit  of  a  single  engine  light  aircraft  is  simulated. 
The  major  components  of  this  simulator  include  the  following:  active  instrumentation 
(e  g.,  altimeter,  tachometer,  throttle),  a  monochromatic  visual  display  that  plots  a  “plan 
view”  of  the  pilot’s  flight  path  in  real-time  and  a  three-degree-of-frecdom  motion  plat¬ 
form.  The  motion  platform  has  the  following  characteristics:  pitch  of  16°  nose  up  and  8° 
nose  down,  producing  a  cockpit  indicator  reading  of  48°  nose  up  and  21°  nose  down;  roll 
of  12.5°  left  or  right  bank,  producing  a  cockpit  indicator  reading  of  ±75°;  and  yaw  of 
300°,  producing  corresponding  heading  changes. 

Two  static  tests  of  balance,  the  Sharpened  Romberg  (SR)  and  the  Stand  on  One 
Leg  Eyes  Closed  (SOLEC)  as  well  as  two  dynamic  tests,  the  Walk  On  Line  Eyes  Closed 
(WOLKC)  and  the  Walk  On  Rail  Eyes  Open  (WOREO)  were  used  as  objective  measures 
of  ataxia.  These  tests  were  specifically  designed  to  avoid  ceiling  effects,  The  procedures 
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and  scoring  methods  are  described  elsewhere  (8,12).  A  simulator  sickness  questionnaire 
was  used  to  assess  subjective  ataxia  (13).  This  questionnaire  required  subjects  to  indi¬ 
cate  the  presence  and  severity  of  28  symptoms  typical  of  simulator  sickness,  using  a 
four-point  scale. 

Procedures 

On  the  first  day  of  the  CAPSS  training  program  members  of  the  control  group 
were  tested  individually  on  each  of  the  four  ataxia  tests  before  and  after  a  70  min  rest 
period.  This  rest  period  is  equivalent  in  duration  to  the  simulator  exposure  experienced 
by  the  experimental  group.  The  tests  were  administered  in  a  random  order  for  each  sub¬ 
ject.  Following  the  second  administration  of  the  balance  tests,  each  subject  responded 
to  the  symptom  questionnaire, 

Subjects  in  the  experimental  group  were  tested  individually  on  the  fourth  day  of 
training  immediately  before  and  after  the  CAPSS  session  in  a  manner  similar  to  the  con¬ 
trol  group.  The  fourth  day  of  training  was  the  first  opportunity  students  had  to  com¬ 
bine  the  skills  they  had  acquired  over  the  previous  three  days  in  order  to  complete  cir¬ 
cuits.  Three  consecutive  circuits  were  required  with  standard  rate  altitude  changes  and 
standard  rate  left  turns.  This  exercise  lasted  approximately  70  min. 

RESULTS 

Table  I  provides  a  list  of  symptoms  and  a  summary  of  the  responses  to  the  symp¬ 
tom  questionnaire.  Stepwise  discriminant  analysis  identified  four  items  which  reliably 
(F(‘t,  20)  —  8.77,  p<0.05)  differentiated  the  control  and  experimental  groups  in  terms  of 
the  frequency  with  which  they  reported  particular  symptoms,  ‘Walking  straight  takes 
more  effort  than  usual’  (item  #3),  ‘energy  drain*  (item  #28),  and  ‘sensations  of  motion’ 
(item  #16)  were  reported  more  frequently  by  the  experimental  group  than  by  the  control 
group,  while  ‘lack  of  interest’  (item  #15)  was  reported  more  frequently  by  the  control 
group.  Since  two  items  reported  more  frequently  by  the  experimental  group  (#3  and 
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#18)  appear  to  reflect  Iom  of  balance,  there  is  reason  to  believe  that  the  simulator  pro¬ 
duced  reliable  subjective  sensations  of  ataxia.  Of  17  aircrew  candidates  exposed  to  the 
CAPSS,  13  reported  the  presence  of  one  or  both  of  these  items,  whereas  this  was  the 
case  for  only  3  of  the  10  candidates  in  the  control  group. 

Figure  1  summarizes  pre-  and  post-test  performance  for  the  control  and  experimen¬ 
tal  groups  on  each  of  the  four  ataxia  tests.  Based  on  the  control  group,  test-rctest  relia¬ 
bilities  were  0,88  for  the  SR,  0.83  for  the  SOLEC,  0.38  for  the  WOLEC  and  0.69  for  the 
WOREO.  Inspection  of  Figure  la  shows  that  both  groups  gained  slightly  in  the  mean 
amount  of  time  they  could  maintain  the  SR.  This  suggests  a  general  improvement  in 
performance.  However,  repeated  measures  analysis  of  variance  revealed  neither  a  group 
by  session  interaction  nor  main  effects  due  to  session  or  group. 

The  results  shown  in  Figure  lb  also  suggest  a  general  improvement  in  performance 
with  repeated  testing  on  the  SOLEC.  Both  groups  were  able  to  stand  on  one  leg  longer, 
on  average,  during  the  second  test  session.  This  observation  was  confirmed  by  an 
analysis  of  variance  which  revealed  a  reliable  session  effect  (F(l,  31)  <==  7.82,  p<0.009)  in 
the  absence  of  a  main  group  effect  or  an  interaction  between  session  and  group. 

An  inspection  of  Figure  lc  shows  a  similar  pattern  for  the  WOLEC  results.  Both 
groups  demonstrated  a  mean  improvement  in  performance  with  repeated  testing  by 
adhering  more  closely  to  the  centre  line  in  their  second  session.  Analysis  of  variance 
revealed  this  effect  to  be  reliable  (F(l,  31)  =  15.79,  p <0,0001)  in  the  absence  of  an 
interaction  between  session  and  group  or  a  main  efTect  due  to  group. 

In  contrast,  the  pattern  of  results  shown  in  Figure  Id  suggests  that  the  WOREO 
scores  for  the  control  group  increased  from  the  pre-  to  the  post-testing  BeBsion,  while 
scores  of  the  experimental  group  did  not.  Analysis  of  variance  indicated  that  the  two 
groups  differed  reliably  in  their  response  to  repeated  testing,  evidenced  by  a  significant 
group  by  session  interaction  (F(l,  31)  —  5.21,  p<0.03). 
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DISCUSSION 

Discriminant  analysis  of  the  responses  to  the  subjective  questionnaire  suggested 
that  simulator-induced  ataxia  was  experienced  by  many  of  the  aircrew  candidates  who 
trained  on  the  CAPSS,  However,  only  one  of  the  four  objective  tests  of  balance,  the 
WOREO,  reliably  differentiated  the  performances  of  the  experimental  and  control  groups 
in  a  manner  consistent  with  the  notion  that  the  simulator  precipitated  observable  evi¬ 
dence  of  ataxia  when  ceiling  effects  were  avoided  and  practice  effects  were  experimentally 
controlled.  One  possible  reason  for  this  finding  is  that  the  objective  ataxia  measures 
employed  in  this  study  may  assess  different  aspects  of  postural  control.  This  point  of 
view  is  consistent  with  the  conclusion  of  Thomley,  Kennedy,  and  Bittner  (9).  and 
implies  that  the  CAPSS  may  affect  dynamic  postural  control  processes  specific  to  the 
WOREO.  Although  performances  on  the  SR  and  SOLEC  were  found  to  be  more  reliable 
they  were  not  as  sensitive  as  the  WOREO  to  simulator  exposure;  the  results  of  this 
study  suggest  that  it  would  be  prudent  to  include  the  WOREO  when  developing  a  test 
battery  for  studying  simulator  induced  ataxia. 
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Table  1,  Frequency  of  symptom  occurrence  in  four  severity  categories  (l=symptom  is 
just  noticeable,  2=  symptom  is  present  but  mild,  3=symptom  is  definitely  present  but 
not  interfering  with  my  activities,  4— symptom  is  definitely  present,  I  have  to  concen¬ 
trate  to  overcome  the  symptom)  for  the  control  (n=16)  and  experimental  (a-  -17)  groups 
after  the  second  set  of  ataxia  tests. 
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Fig.  lb.  Mean  standing  time  for  the  Stand  or  One  Leg  Eyes  Closed  (SOLEC)  in  the  pre- 
and  post-test  conditions  for  the  control  (n*16)  and  experimental  (n=  1 7)  groups,  Bars  represent 
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Fig.  lc,  Mean  distance  from  centre  line  for  Walk  on  Line  Eyes  Closed  (WOLEC)  in 
the  pre-  and  post-test  conditions  for  the  control  (n=16)  and  experimental  (n=17) 
groups.  Bars  represent  SEMs. 
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Fig.  Id.  Mean  number  of  steps  completed  for  the  Walk  On  Rail  Eyes  Open  (WOREO)  in 
the  pro-  and  post-test  conditions  for  the  control  (n=16)  and  experimental  (n*17)  groups.  Bars 
represent  SEMs. 
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